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Abstract. - 

We show how to switch on and off the ratchet potential of a collective Brownian motor, 
depending only on the position of the particles, in order to attain a current higher than or at 
least equal to that induced by any periodic flashing. Maximization of instant velocity turns out 
to be the optimal protocol for one particle but is nevertheless defeated by a periodic switching 
when a sufficiently large ensemble of particles is considered. The protocol presented in this 
letter, although not the optimal one, yields approximately the same current as the optimal 
protocol for one particle and as the optimal periodic switching for an infinite number of them. 



Introduction. - Brownian motors, acting as thermal fluctuation rectifiers, have been at- 
tracting considerable attention in the past ten years mainly due to their potential applications 
in biology, condensed matter and nanotechnology but also to their theoretical relevancy in 
statistical mechanics [1,2]. In most of the cases, rectification is achieved by means of an exter- 
nal periodic or random perturbation applied to an equilibrium system with some underlying 
spatial or temporal asymmetry. 

However, it is only recently that research has been focused on introducing control in Brow- 
nian ratchets. Tar lie and Astumian studied in [3] the effect of a controllable time modulation 
of the applied sawtooth potential and find the modulation that maximizes particle flow. Other 
ways to control particle current have been proposed that are specially useful in systems where 
the ratchet potential parameters are not easily tunable, as in most two dimensional ratchet 
setups where the Brownian particles interact with an asymmetric substrate. Examples of 
these devices are a rectifier of magnetic flux quanta in superconductors [4] or synthetic ion 
channels [5]. According to Savel'ev et al., flux in some of these ratchets can be controlled by 
addition of other species of particles that interact with the original ones [6] . Alternatively, the 
application of two mixing signals could control ratchet-like particle transport of ferrofluids or 
dislocations in crystalline solids, pumping of electrons in quantum dots or colloids in arrays 
of optical tweezers [7]. 
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All the control strategies mentioned so far share the property of being open-loop control 
policies, that is, they do not use any information about the state of the system. In contrast, 
we considered in ref. [8] the idea of a feedback controlled perturbation, i.e., a modulation of 
the ratchet potential depending on the state of the system. Such a feedback control could 
be implemented in systems where particles are monitored, as in some experimental setups 
of colloidal particles [9,10]. The system described in ref. [8] consisted on an ensemble of 
Brownian particles in a flashing ratchet potential that can be switched on or off depending 
on the position of particles, with the aim of maximizing the current. We studied in detail 
a protocol that maximizes the instant velocity of the center of mass of the ensemble. That 
(closed-loop) protocol is optimal for one particle and performs better than any periodic (open- 
loop) flashing for ensembles of moderate sizes, but is defeated by random or periodic switching 
for large ensembles. Furthermore, it can be shown that particle current vanishes as N — > oo, 
even though the state of the potential is chosen so that the center of mass velocity is maximal 
at every instant. 

In this letter we propose a modification of the aforementioned feedback control protocol 
that may switch off the potential even if that implies a loss of instantaneous velocity, or switch 
it on when that makes the center of mass initially recede. Nevertheless, this new protocol beats 
the original one for a sufficiently large number of particles. Although it might be surprising 
at first sight, this means you must stop or even move backwards at certain periods of time in 
order to move faster on average. 

In contrast, maximization of the instant velocity protocol is a "greedy" strategy and will 
therefore never switch the potential off if particles are still moving forward or switch it on if 
this means an initial backward movement. In some sense, the new protocol performs better 
by being less greedy, an effect also analyzed in [11,12] for the case of paradoxical games, which 
are closely related to the flashing ratchet. 

The model. The model we will consider here consists of an ensemble of N non- 
interacting overdamped Brownian particles at temperature T in a asymmetric periodic poten- 
tial that can be switched on or off. The dynamics is described by the Langevin equation 

7±«(t) = a(t)F(xi(t))+Zi(t) ; i = 1 . . . N, (1) 

where Xi(t) the position of particle i, 7 is the friction and are thermal noises with zero 
mean and correlation = 2jkTSijS(t — t'). The force is given by F(x) = —V'(x). 

As the ratchet potential V(x), we will consider from now on the one depicted in fig. [TJ given 
by V(x) — 2Vq (sin(2'Kx/L) + | sin(47rx/L)) /3-v/3, with Vb = 5kT. We have found analogous 
results for other heights of the potential and for other smooth potential shapes. 

Finally, a(t) is a control parameter which we assume that can take on the values 1 and 0, 
i.e., the only allowed operations on the Brownian motor consist in switching on and off the 
potential V(x). 

Control strategies. - The following two control strategies were previously compared in [8] , 
focusing on the induced current of particles. 

• Optimal periodic switching: a(t + r on + r ff) = oi(t), with a(t) = 1 for t G [0, r on ), 
and a{t) = for t G [r on ,T on + r G ff). This case is equivalent to the periodic flashing 
ratchet, since particles are independent, although with different periods for the on and 
off steps. In the following, the switching times r on and r g are set to achieve the highest 
stationary current. For kT = 1 and Vq = 5kT, these values are r on = 0.06L 2 /D and 
r off = QML 2 /D. 



Luis Dinis, Juan M.R. Parrondo and Francisco J. Cao: Closed-loop control. 



3 



T 




a I i I i I i I i I i I 

0.5 1 1.5 2 2.5 

X 



Figure 1 - Ratchet potential V(x) = |% (sin(27ra;/L) + § sin(47rx/L)) , for Vb = 5kT (Units: kT = 1 
and L = 1). 

• Maximization of center of mass instant velocity: 

a(t) = 9(/(f)) (2) 

where 

1 N 

is the net force per particle if the ratchet potential were on, and @(y) is the Heaviside 
function, Q(y) = 1 if y > and otherwise. As can be deduced from Eq. {I), this 
strategy maximizes the instant velocity of the center of mass, x cm (t) — -k &i{t)- 

As stated above this protocol is the optimal one for one particle, performs better than 
any periodic switching only up to approximately a thousand particles (for our choice of the 
potential), and gives a vanishing current for N — > oo (see below fig. [3]). For large N, any 
switching of the potential is induced by fluctuations in the force per particle around zero, as 
shown in fig. [2^. Since fluctuations vanish as 1/s/N, then the system gets trapped in either 
the on or off state longer and longer times as N increases, slowing down the switching that 
makes the ratchet work (see ref. [8] for details). 

This can be better understood in the limiting case N — oo, where the system evolves 
without fluctuations. The distribution of particles p(x, t) coincides with the solution of the 
following mean-field Fokker-Planck equation: 

jd tP (x, t) = [-a(t)d x F(x) + kTdl] p{x, t). (4) 

Following [8], evolution of the net force per particle f(t) for sufficiently large N would have two 
contributions: the evolution of f°°(t) = (F(x)) where the average (•) is taken over the solution 
p(x, t) of Fokker-Planck eq. ([!]), plus fluctuations of order \J (F 2 ) /N. As explained above, the 
switching frequency is so slow that the system almost reaches the equilibrium distribution of 
either the on or off potential before a switch occurs. Hence, we can approximately compute 
/°° (t) in two parts, one corresponding to either state of the potential. The "on" part (t) is 
computed by numerical integration of eq. (j4| with initial condition given by the equilibrium 
distribution of the off potential and conversely, f^(t) with initial condition given by the 
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Figure 2 - Time dependence of the net force per particle f(t) in simulations with N = 10 6 for instant 
velocity of the center of mass maximization (a) and feedback control with thresholds (b). Thresholds 
are depicted as dashed horizontal lines. 

equilibrium distribution of the on potential. These solutions f^(t), f£g(t) would respectively 
represent, after adding the fluctuations, the cusps and valleys in fig. [2^. 

Figure [2] shows an initial increase or decrease of the force per particle right after every 
switch, followed by a tail that slowly decays towards zero. The larger the number of particles, 
the smaller the fluctuations and the longer it takes f(t) to become so small that a fluctuation 
makes it cross zero and induce a switch of the potential. If N is sufficiently large, this takes 
in average longer than the optimal periodic switching time. Moreover, since fluctuations are 
small, this control protocol ends up behaving approximately periodically in time but with 
switching periods longer than the optimal ones. Hence, it yields a slower motion of the 
particles than that achieved by the optimal periodic flashing. 

The idea underlying the new threshold control policy is to modify that feedback control 
protocol to prevent the trapping by inducing the switching of the potential when the net force 
per particle crosses some threshold values that are now different from zero. Thresholds work 
by removing the long decaying tails in the evolution of the force per particle that produce the 
trapping and modifying the switching times so that they match the optimal periodic ones for 
large N. This situation is represented in fig. [2Jd. However, to get rid only of these tails while 
retaining the remaining part, the switching must only occur when the threshold is crossed in 
the appropriate direction, implying that we need to compute or estimate the sign of the time 
derivative of the average force per particle. 

In the limit N — > oo, evolution of f(t) is well described by f££(t) and f^g(t). Hence, to 
induce a switch at time r on we should force the system to change the state of the potential 
when f(t) attains a threshold value u on — f^(r on ) if the potential is on and u q — /^§(T ff) 
when potential is off. However, if the ratchet potential is on for example, we would be 
interested in switching when the force f(t) crosses u on and is decaying towards zero and not 
when it is increasing, which would be too early. This is readily achieved by switching off the 
potential only when f(t) crosses u on with negative slope. Equivalently, the potential should 
be switched on only when f(t) crosses u a g with positive slope. In order to translate this into 
a feedback policy, we need an estimation for this slope in terms of position of the particles. 
Using Langevin equation {T]), we can write 

i i i 
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Figure 3 - Simulation results of the average of the center of mass velocity {x c . m .}, for the periodic 
switching with optimal periods r on = 0.06L 2 /D and r tf = 0.05L 2 /D (dashed line); feedback control 
with thresholds (circles); and maximization of center of mass velocity (triangles). The inset shows 
the region where the strategies cross in more detail. A line through the points has been drawn to 
guide the eye. 



For a given state of the system Xi(t), a good estimate for the slope of f(t) is 

f exp ( Xi (t)) = —Y^a(t)F( Xi (t))F'( Xi (t)) + —J2F"( Xl (t)) (6) 

i i 

Notice expression (O can only be used for smooth potentials. 

Gathering all the pieces, we can express threshold control policy in the following way 

• Threshold control: 

'1 itf(t)>u on 

a ^ _ . 1 if "off < /(*) < u on and f exp ( Xi ) > ^ 

if u s < f(t) < u on and f exp ( Xi ) < 

.0 if/(t)<« off 

where f(t) and / eX p are the net force per particle and the estimate for the time derivative 

of its average as defined in © and ©, respectively. 

To compute the thresholds one can simulate Langevin equation |T]) for a sufficiently large 
number of particles and obtain the evolution of the net force f(t) under the optimal periodic 
switching. Since the number of particles is large, this is almost equivalent to solving Fokker- 
Planck equation to get f°°(t). Thresholds are given by u on = /™(T on ) and u a s = f^s( T os) and 
hence, averaging the values of the force at switching times should give a reasonable estimate 
for either threshold, once the stationary regime has been reached. Doing so for N = 10 7 , gives 
u on ~ 0.54/cT/L and u a g ~ — 0.30kT/L. These are the thresholds used in the simulations 
whose results are shown in fig. [31 
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Results and conclusions. - The response of the system to the three different switching 
protocols has been measured in terms of the resulting particle current or average center of 
mass velocity in the stationary regime, as given by 

(Xcm) = t llm 7 ( 8 ) 

Figure [3] shows simulation results for the three strategies, where (x^ m ) is plotted against the 
number of particles N for Vq = 5kT. For this potential, the highest center of mass velocity is 
achieved for switching periods with values r on = 0.06L 2 /D and t s = 0.05L 2 /D. As already 
pointed out instant velocity x cm (t) maximization yields higher velocity than the periodic 
strategy only up to about a thousand particles and the velocity vanishes when N — > oo. 
On the other hand, the feedback control with the aforementioned thresholds gives a non- 
vanishing speed for the center of mass that converges to that achieved by the optimal periodic 
switching, while retaining approximately the same behaviour, for small ensemble sizes, as the 
maximization of instant velocity. Thus, the feedback strategy described in eq. ||7J) performs 
better than or at least equal to the best open-loop control strategy, no matter the number of 
particles to be controlled. 

It may be surprising at first sight that the feedback control works nicely for small ensemble 
sizes since it relies on arguments only valid for a large number of particles. However, fluctu- 
ations of the force f(t) are so huge for small N that both feedback control policies become 
effectively the same. 

In conclusion, we have devised a feedback control or switching policy that gives higher 
particle currents than the best periodic strategy for any number of particles in a collective 
ratchet. The new strategy is a modification of the strategy ([2]) already introduced in ref. [8]. 
It is worth noting that the latter is a policy that maximizes the instantaneous value of the 
current and ends up inducing feeble currents in the stationary regime if the number of particles 
is sufficiently large. In contrast, the switching on of the potential for the modified strategy 
produces an instantaneous negative flux and the switching off takes place when particles could 
still keep moving. However, both sacrifices are eventually compensated and the final result 
is that particles actually move faster in the long run. Hence, the modified strategy performs 
better by being less "greedy" . This same effect has been also pointed out by Cleuren and Van 
den Broeck in the ratchet inspired paradoxical games [11, 12]. 

Finally, we would like to remark that, although finding the optimal protocol for N > 1 is 
still an unsolved problem. We believe the threshold control presented here should not perform 
much worse than the true optimal: it yields approximately the same current for N = 1 than 
the true optimal for one particle and on the other hand, it is equivalent to the optimal periodic 
one for N — > oo. 
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